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Background of the Invention 

1. Field of the Invention 

[1] The present invention relates generally to display of digital image data. 
2* Description of the Related Art 

[2] Modern display devices are commonly equipped with an ability to display a 
picture-in-picture window. The picture-in-picture window is used for displaying an 
overlay image on a background image. For example, the background image may represent 
a desktop view of a computing system, and the overlay image (i.e., picture-in-picture 
window) may represent an image captured by a digital camera. Traditionally, to display 
the overlay image on the background image, separate portions of display memory are 
required. One portion of display memory is required for a main window, and another 
portion of display memory is required for a sub-window. The portion of display memory 
for the main window contains display data for the entire background image, and the 
portion of display memory for the sub-window contains display data for the overlay 
image. The background image data is retrieved from the main window portion of display 
memory and displayed. Then, the overlay image data is retrieved from the sub-window 
portion of display memory and displayed over a portion of the background image. 
[3] With the traditional technique for displaying the overlay image on the background 
image, the display memory is required to be large enough to accommodate data for both 
the entire main window (i.e., entire background image) and the sub-window (i.e., overlay 
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image). A set of pixels used to define the display image will have two sets of data stored 
in the display memory: a first set of data for display in a context of the main window and 
a second set of data for display in a context of the sub-window. Therefore, additional 
display data is stored in the display memory for each pixel defining the sub-window 
display area. 

[4] A larger display memory requires more silicon space for implementation and 
consumes more power during operation. Also, the larger display memory increases an 
overall device cost. Furthermore, since storage of additional display data is required for a 
each pixel within the sub-window display area, it is necessary to implement separate sub- 
window functionality (i.e., logic) for determining boundaries that are indicative of which 
portion of memory (i.e., that containing main window display data or that containing sub- 
window display data) to retrieve data from for a given pixel. 

[5] In view of the foregoing, there is a need for an apparatus and method that will 
provide for overlaying of image data without requiring storage and retrieval of additional 
display data. 
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Summary of the Invention 

[6] Broadly speaking, the present invention fills these needs by providing an image 
overlay apparatus and corresponding method of operation. More specifically, the present 
invention provides for combining multiple sets of display data in an efficient manner 
5 while utilizing a display memory having a capacity to store one complete set of display 
data for an entire viewable area of a display component. In the present invention, key data 
is written to the display memory to define a portion of the viewable area of the display 
component that will be used for rendering an incoming set of display data. The portion of 
the viewable area of the display component used for rendering the incoming display data 

10 can be defined as a picture-in-picture window. The incoming display data can represent a 
stand-alone image (e.g., picture) or a sequence of images (e.g., video). The apparatus of 
the present invention can be operated in either of two modes: snapshot mode and view 
mode. When operated in snapshot mode, the present invention overwrites the key data 
within the display memory with the incoming stand-alone image display data, prior to 

15 transmission of the display data to the display component. When operated in view mode, 
the present invention does not require that the display data for the incoming sequence of 
images be written to the display memory. Rather, in view mode, the present invention 
uses the display data of the incoming sequence of images to modify the key data as the 
display data is transmitted to the display component. Thus, in view mode, the key data 

20 remains stored in the display memory for use with each incoming frame representing the 
sequence of images. 

[7] In one embodiment, an image overlay apparatus is disclosed. The image overlay 
apparatus includes a memory for storing a first set of display data. The first set of display 
data includes a set of key data associated with a key data value. The image overlay 
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apparatus also includes an input for receiving a second set of display data and an output 
for transmitting a set of output display data. A comparison component of the image 
overlay apparatus is configured to compare a portion of the first set of display data to the 
key data value to determine whether the portion of the first set of display data is to be 
5 modified. If the portion of the first set of display data is to be modified, the modification 
is performed with a corresponding portion of the second set of display data. 
[8] In another embodiment, a display controller is disclosed. The display controller 
includes a memory region configured to store display data within which key data is 
integrated. The display controller also includes comparison circuitry that is configured to 

10 receive both image overlay data and the display data from the memory region. The image 
overlay data is received from a source external to the memory region. Both the image 
overlay data and the display data are received by the comparison circuitry in accordance 
with a synchronization signal. The comparison circuitry is further configured to modify 
the key data using the image overlay data during transmission of the display data to a 

15 display panel. 

[9] In another embodiment, a method for operating an image overlay apparatus is 
disclosed. The method includes establishing a portion of a first set of display data as key 
data, wherein the key data is defined by a key data value. The method also includes 
receiving a second set of display data defining an image of a given shape and size. The 

20 method further includes comparing a portion of the first set of display data to the key data 
value. The portion of the first set of display data that is compared to the key data value 
represents an equivalent shape and size of the image defined by the second set of display 
data. The method continues with modifying the key data within the portion of the first set 
of display data using corresponding portions of the second set of display data. The 

25 method also includes transmitting the first set of display data to a display component. 
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[10] Other aspects of the invention will become more apparent from the following 
detailed description, taken in conjunction with the accompanying drawings, illustrating by 
way of example the present invention. 
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Brief Description of the Drawings 



[11] The invention, together with further advantages thereof, may best be understood 
by reference to the following description taken in conjunction with the accompanying 
drawings in which: 

Figure 1 is an illustration showing a high-level architecture of a device for 
displaying digital image data, in accordance with one embodiment of the present 
invention; 

Figure 2 is an illustration showing architectural features of the display controller 
that are used for displaying snapshot data within a specified portion of the viewable area 
of the display component, in accordance with one embodiment of the present invention; 

Figure 3 is an illustration showing architectural features of the display controller 
that are used for displaying view data within a specified portion of the viewable area of 
the display component, in accordance with one embodiment of the present invention; 

Figure 4 is an illustration showing architectural features of the display controller 
used to combine snapshot mode and view mode functionality, in accordance with one 
embodiment of the present invention; and 

Figure 5 shows a flowchart illustrating a method for operating an image overlay 
apparatus, in accordance with one embodiment of the present invention. 
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Detailed Description 

[12] Broadly speaking, an invention is disclosed for an image overlay apparatus and 
corresponding method of operation. More specifically, the present invention provides an 
apparatus and method for combining multiple sets of display data in an efficient manner 
5 that optimizes memory usage. It should be appreciated that the present invention can be 
implemented in numerous ways, including as a process, an apparatus, a system, a device, 
or a method. Several exemplary embodiments of the invention will now be described in 
detail with reference to the accompanying drawings. 

[13] In the following description, numerous specific details are set forth in order to 
10 provide a thorough understanding of the present invention. It will be apparent, however, 
to one skilled in the art that the present invention may be practiced without some or all of 
these specific details. In other instances, well known process operations have not been 
described in detail in order not to unnecessarily obscure the present invention. 
[14] Figure 1 is an illustration showing a high-level architecture of a device for 
15 displaying digital image data, in accordance with one embodiment of the present 
invention. The device includes a display controller 103, a microprocessor unit (MPU) 
host 107, a display component 105, and a display data source 101. The display controller 
103 is defined and operated to control a transmission of display data to the display 
component 105 as indicated by an arrow 113. The MPU host 107 is defined and operated 
20 to perform digital processing operations. The MPU host 107 and display controller 103 
are capable of communicating with each other as indicated by an arrow 111. The display 
data source 101 provides the display controller 103 with a set of display data as indicated 
by an arrow 109. In various embodiments, the display data source 101 can be a digital 
video camera, a digital camera, an electromagnetic transmission, a digital data storage 
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device, or an external MPU host, among others. Depending on the particular embodiment, 
the display controller 103 can be configured with a data port, a network interface card, or 
an antenna, among others, to receive the set of display data provided from the display data 
source 101. Additionally, the display controller 103 can be configured to receive the set of 
5 display data in any format. For example, the set of display data may be in any suitable 
digital format, which includes various color formats, among others. In one embodiment, 
the set of display data is transmitted in digital format after having been captured and 
processed by digital imaging circuitry. In another embodiment, the set of display data is 
transmitted in digital format after having been converted from JPEG format by a JPEG 
10 CODEC. In yet another embodiment, the set of display data is transmitted in YUV format 
from an MPU host either associated with or external to the device for displaying digital 
image data. 

[15] The display controller 103 is configured to operate in two modes: 1) snapshot 
mode; and 2) view mode. In snapshot mode, the set of display data received by the 

15 display controller 103 represents a single frame of image data. The single frame of image 
data contains data for each pixel within a portion of a viewable area of the display 
component 105. For purposes of discussion in the remainder of this document, the set of 
display data received by the display controller 103 during operation in snapshot mode is 
referred to as snapshot data. When operated in snapshot mode, the display controller 103 

20 transmits the snapshot data to the display component 105 to be displayed. 

[16] Figure 2 is an illustration showing architectural features of the display controller 
103 that are used for displaying snapshot data within a specified portion of the viewable 
area of the display component 105, in accordance with one embodiment of the present 
invention. In one embodiment, the snapshot data represents a single frame of image data 

25 provided by a digital camera. In another embodiment, the snapshot data is a single frame 
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of image data obtained from a set of stored image data (e.g., JPEG data) that is decoded 
for processing and display. It should be understood, however, that the present invention is 
not limited to receiving the snapshot data from a particular display data source 101. The 
display controller 103 includes an input module 202 for receiving the snapshot data. The 
5 snapshot data is transmitted from the display data source 101 to the input module 202 of 
the display controller 103 as indicated by the arrow 109. Once received, the snapshot data 
is communicated to a snapshot comparison component 201 as indicated by an arrow 209. 
The snapshot comparison component 201 is in two-way communication with a display 
memory 203 as indicated by an arrow 217. As such, the snapshot comparison component 

10 201 is capable of reading from and writing to the display memory 203. 

[17] The display memory 203 is capable of storing image data for each pixel within a 
coordinate system used to define the viewable area of the display component 105. In 
snapshot mode, the snapshot data is written to the display memory 203. However, the 
snapshot data is only written to portions of the display memory 203 containing a 

15 designated key data value. For example, in the case where the snapshot data represents a 
rectangular image, there will be a corresponding portion of the display memory 203 for 
storing display data capable of defining the complete rectangular image associated with 
the snapshot data. For purposes of discussion, this corresponding portion of the display 
memory 203 is referred to as an image overlay area. An example image overlay area 204 

20 is shown within the display memory 203 of Figure 2. In one embodiment, prior to 
processing of the snapshot data by the snapshot comparison component 201, the 
designated key data value is stored for a number of pixels within the image overlay area. 
The number of pixels for which the designated key data value is stored represents a set of 
key data that can be defined to form a key data area of variable shape, size, and position. 

25 For exemplary purposes, key data area 205A is shown in Figure 2 to define a circular 
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area. In one embodiment, the user can control the position of the image overlay area with 
respect to the key data area. 

[18] With respect to the example embodiment of Figure 2, the snapshot comparison 
component 201 performs a pixel-by-pixel comparison of the data stored in the image 
5 overlay area 204 of the display memory 203 with the designated key data value. If the 
data stored in the image overlay area 204 for a given pixel is equal to the designated key 
data value, the data stored in the image overlay area for the given pixel will be 
overwritten with the corresponding snapshot data for the given pixel. Conversely, if the 
data stored in the image overlay area 204 for a given pixel is not equal to the designated 

10 key data value, the data stored in the image overlay area for the given pixel will be 
retained and the corresponding snapshot data for the given pixel will be discarded or 
blocked. In this manner, each pixel within the corresponding portion of the display 
memory 203 that is within the image overlay area 204 is analyzed and processed by the 
snapshot comparison component 201. With respect to the example of Figure 2, once 

15 processing by the snapshot comparison component 201 is completed, the circular portion 
of the snapshot data that is coincident with the key data 205A will be stored within the 
display memory 203. A complete set of display data stored within the display memory 
203 is transmitted to an output module 206 of the display controller 103 as indicated by 
an arrow 219. The display component 105 is capable of receiving the complete set of 

20 display data from the output module 206 of the display controller 103 as indicated by the 
arrow 113. The display component 105 is configured to render the complete set of display 
data, including the circular portion of the snapshot data. Also, in snapshot mode, since the 
key data 205A is overwritten in the display memory 203 by the incoming snapshot data, 
one frame of snapshot data may be displayed at a given time. To display another frame of 

25 snapshot data, the key data 205A is rewritten to the display memory 203 prior to 
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processing of the snapshot data by the snapshot comparison component 201. It will be 
apparent to one skilled in the art that the various components of the display controller 103 
can be implemented as electronic circuits using logic gates. For example, snapshot 
comparison component 201 includes comparators as well as other known circuitry to 
5 achieve the functionality described herein. 

[19] In one embodiment, the complete set of display data can be transmitted to an 
encode/decode device 207 as indicated by an arrow 213. The encode/decode device 207 
can be an encoding component capable of receiving the complete set of display data and 
converting the complete set of display data to a digital format suitable for storage. In one 

10 embodiment, the encode/decode device 207 is a Joint Photographic Experts Group 
j (JPEG) coder-decoder (CODEC). The JPEG CODEC includes hardware or software for 
converting display data to JPEG code and vice versa. Thus, the JPEG CODEC is capable 
of converting the complete set of display data to a JPEG format suitable for storage on a 
computer readable media. After being converted to the digital format suitable for storage, 

15 the complete set of display data can be transmitted to the MPU host 107, as indicated by 
arrows 215 and 111, for storage or further processing. Also, as indicated by arrows 215 
and 111, the encode/decode device 207 is capable of receiving and decoding JPEG 
formatted data from the MPU host 107. The decoded JPEG data can be transmitted from 
the encode/decode device 207 to the snapshot comparison component 210 for processing 

20 in the manner previously discussed. Thus, in one embodiment, the JPEG data can serve as 
the display data source. 

[20] In one embodiment, the designated key data value is represented as a data value 
mapped to a color (i.e., RGB value). In this embodiment, the designated key data value is 
referred to as a key color. In one embodiment, the key color is user specified. Key data 
25 specifications (i.e., color value, shape, size, and position in the viewable area of the 

Customer No.: 20178 1 1 Express Mail Label No EV311301818US 



VP089 

display component 105) can be specified by the user through the MPU host 107 and 
stored in internal registers within the display controller 103. The shape, size, and position 
of the key data area (i.e., key color area) is variable. Thus, the key data area can be 
defined to allow the snapshot data to be displayed in any suitable shape (e.g., square, 
5 heart, cloverleaf, etc ...), size, and position in the viewable area of the display component 
105. 

[21] When the display controller 103 is operated in view mode, the set of display data 
received by the display controller 103 represents multiple frames of image data 
transmitted in a particular sequence at a particular rate. For example, in one embodiment, 

10 the multiple frames of image data correspond to a digital video stream. For purposes of 
discussion in the remainder of this document, the set of display data received by the 
display controller 103 during operation in view mode is referred to as view data. When 
operated in view mode, the display controller 103 transmits the view data in an 
appropriate sequence and at an appropriate rate to the display component 105 to be 

15 displayed. 

[22] Figure 3 is an illustration showing architectural features of the display controller 
103 that are used for displaying view data within a specified portion of the viewable area 
of the display component 105, in accordance with one embodiment of the present 
invention. In one embodiment, the view data represents a digital video stream including 

20 multiple frames of image data transmitted sequentially from a digital video camera. In 
another embodiment, the view data represents a digital video stream obtained from a set 
of stored video data that is decoded for processing and display. It should be understood, 
however, that the present invention is not limited to receiving the view data from a 
particular display data source 101. The view data is received by the display controller 103 

25 at the input module 202. The view data is transmitted from the display data source 101 to 
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the input module 202 of the display controller 103 as indicated by the arrow 109. Once 
received, the view data is communicated to a view comparison component 301 as 
indicated by an arrow 303. The view comparison component 301 is in communication 
with the display memory 203 as indicated by an arrow 307. As such, the view comparison 

5 component 301 is capable of reading from the display memory 203. 

[23] As previously described, the display memory 203 is capable of storing image data 
for each pixel within the coordinate system used to define the viewable area of the display 
component 105. Unlike snapshot mode, in view mode the view data is not written to the 
display memory 203. Rather, the view data is used to modify designated key data during 

10 transmission of the complete set of display data from the display memory 203 to the 
display component 105. In one embodiment, modification of the key data is performed by 
replacing the key data with corresponding view data. In another embodiment, 
modification of the key data includes performing logical operations with the display data 
and the key data. Examples of the logical operations that can be performed include AND, 

15 OR, XOR, AVG, BITSHIFT LEFT, BITSHIFT RIGHT, among others. It should be 
appreciated by those skilled in the art that modification of the key data can be achieved by 
performing other logical operations not explicitly exemplified. For example, in the case 
where the view data represents a sequence of rectangular images (i.e., frames), there will 
be a corresponding portion of the display memory 203 for storing display data capable of 

20 defining the complete rectangular image associated with each frame of the view data. For 
purposes of discussion, this corresponding portion of the display memory 203 is referred 
to as a frame overlay area. An example frame overlay area 304 is shown within the 
display memory 203 of Figure 3. In one embodiment, prior to processing of the view data 
by the view comparison component 301, the designated key data value is stored for a 

25 number of pixels within the frame overlay area. The number of pixels for which the 
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designated key data value is stored represents a set of key data that can be defined to form 
a key data area of variable shape, size, and position. An example key data area 205B is 
shown in Figure 3 to define a circular area. The user can control the position of the frame 
overlay area with respect to the key data area as mentioned above. 
5 [24] The view comparison component 301 performs a pixel-by-pixel comparison of the 
data stored in the frame overlay area 304 of the display memory 203 with the designated 
key data value. The pixel-by-pixel comparison is performed by the view comparison 
component 301 during transmission of data from the display memory 203 to the display 
component 105. With respect to Figure 3, data is transmitted from the display memory 
10 203 to the view comparison component 301 as indicated by an arrow 307. The view 
comparison component 301 performs the pixel-by-pixel comparison of the data stored in 
the frame overlay area 304. If the data stored in the frame overlay area 304 for a given 
pixel is equal to the designated key data value, the corresponding view data for the given 
pixel will be used to modify the given pixel data transmitted from the display memory 
15 203. Conversely, if the data stored in the frame overlay area 304 for the given pixel is not 
equal to the designated key data value, the data stored in the frame overlay area for the 
given pixel will be retained and the corresponding view data for the given pixel will be 
discarded or blocked. Once appropriate pixel data modifications are made, the view 
comparison component 301 transfers the pixel data to the output module 206 of the 
20 display controller 103 as indicated by the arrow 309. In this manner, each pixel within the 
corresponding portion of the display memory 203 that is within the frame overlay area 
304 is analyzed and processed by the view comparison component 301. It should be noted 
that when operating in view mode, the incoming view data is not written to the display 
memory 203 prior to transmission to the display component 105. Additionally, it should 
25 be appreciated that the various components of the display controller 103, as shown in 
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Figure 3, can be implemented as electronic circuits using logic gates and other known 
electronic components (e.g., comparators). 

[25] With respect to the example of Figure 3, once processing by the view comparison 
component 301 is completed for a given frame of view data, the circular portion of the 
5 view data that is coincident with the key data 205 B has been transmitted to and displayed 
by the display component 105. Also, in view mode, since the key data 205B is not 
overwritten in the display memory 203 by the incoming view data, it is not necessary to 
rewrite the key data 205B between successive frames of the view data. 
[26] In view mode, view data can be transmitted from the display data source 101 to 

10 the display component 105 in a synchronous manner to avoid visual anomalies. With 
respect to Figure 3, arrows 305A and 305B are shown to indicate transmission of a 
synchronization signal from the display data source 101 to both the display memory 203 
and the view comparison component 301. The synchronization signal is used by the 
display memory 203 and the view comparison component 301 to ensure that view data for 

15 a given pixel is compared to the appropriate frame overlay area 304 pixel data during 
transmission of data from the display memory 203 to the display component 105. For 
example, in one embodiment, digital video data is transmitted from a digital video camera 
to an LCD panel in synchronization with a vertical sync signal of the associated digital 
video stream to avoid visual anomalies. In this embodiment, whenever a vertical sync 

20 signal occurs, the frame overlay area 304 pixel data is transmitted from the display 
memory 203 to the LCD panel. If the transmitted frame area 304 pixel data equals the 
designated key data, the transmitted frame area 304 pixel data is modified using the 
corresponding digital video data transmitted from the camera. Additionally, certain 
embodiments may incorporate timing requirements for how data should be sent from the 

25 view comparison component 301 to the display component 105. In these embodiments, 
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the display controller 103 is configured to control the data transmission from the view 
comparison component 301 to comply with the timing requirements of the display 
component 105. 

[27] In a manner similar to the snapshot mode, one embodiment of the view mode 
5 defines the designated key data value as a data value mapped to a color (i.e., RGB value). 
In this embodiment, the designated key data value is referred to as a key color. In one 
embodiment, the key color is user specified. Key data specifications (i.e., color value, 
shape, size, and position in the viewable area of the display component 105) can be 
specified by the user through the MPU host 107 and stored in internal registers within the 

10 display controller 103, as discussed with respect to the snapshot mode. The shape, size, 
and position of the key data area (i.e., key color area) is variable. Thus, the key. data area 
can be defined to allow the view data to be displayed in any suitable shape (e.g., square, 
heart, clover leaf, etc ...), size, and position in the viewable area of the display component 
105, during either view mode or snapshot mode. 

15 [28] Figure 4 is an illustration showing architectural features of the display controller 
103 used to combine snapshot mode and view mode functionality, in accordance with one 
embodiment of the present invention. Each of the components incorporated into the 
display controller 103 of Figure 4 are configured to function as previously described with 
respect to the snapshot and view modes of operation. When the display controller 103 is 

20 operated in snapshot mode, the view comparison component 301 is inoperable and serves 
to pass the data transmitted from the display memory 203 to the output module 206 of the 
display controller 103. Also, when the display controller 103 is operated in view mode, 
the snapshot comparison component 201 is inoperable, thus ensuring that the key data 
205 in display memory 203 is not overwritten. 
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[29] Figure 4 includes an additional connection 401 between the view comparison 
component 301 and the encode/decode device 207. The additional connection 401 allows 
the display data that is transmitted from the view comparison component 301 to the 
output module 206 of the display controller 103 to also, or alternatively, be transmitted to 
5 the encode/decode device 207. As previously discussed, the encode/decode device 207 
can be an encoding component capable of receiving and converting the display data to a 
digital format suitable for storage. In one embodiment, the encode/decode device 207 is a 
JPEG CODEC capable of converting the display data to a JPEG format suitable for 
storage on a computer readable media. After being converted to the digital format suitable 
10 for storage, the display data can be transmitted to the MPU host 107, as indicated by 
arrows 215 and 1 1 1 , for storage or further processing. 

[30] In one embodiment, the display data source 101, MPU host 107, display 
component 105, and display controller 103 can all be on-board a device. For example, in 
one embodiment the device is a wireless phone having a digital video camera as the 

15 display data source 101, an MPU host 107, an LCD panel as the display component 105, 
and the display controller 103 of the present invention. Additionally, the display 
component 1 05 of the device may have integrated memory capability. Figure 4, shows a 
representation of the display component 105 having an integrated memory 403. The 
display component 105 with integrated memory 403 is capable of refreshing the display 

20 from the integrated memory 403. One skilled in the art will appreciate that the use of a 
display component 105 with integrated memory 403 allows the display data to be 
transmitted from the view comparison component 301 to the display component 105 
without regard to display component timing requirements. Additionally, the embodiment 
incorporating the display component 105 having integrated memory 403 simplifies the 

25 timing interface between the display memory 203, the view comparison component 301, 
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and the display component 105. It should be understood, however, that the display 
controller 103 of the present invention is equally capable of operating with both a display 
component 105 having integrated memory 403 and a display component 105 not having 
integrated memory 403. Additionally, while view comparison component 301 and 
5 snapshot comparison component 201 are shown as separate components, it should be 
appreciated that the two components may be combined into one comparison module. The 
comparison module includes circuitry configured to perform the functionality of both the 
view comparison component 301 and the snapshot comparison component 201. 
[31] Figure 5 shows a flowchart illustrating a method for operating an image overlay 

10 apparatus, in accordance with one embodiment of the present invention. In one 
embodiment, the image overlay apparatus is defined as the previously discussed display 
controller. The method includes an operation 501 for establishing a portion of a first set 
of data as key data, wherein the key data is defined by a key data vaiue. The key data can 
be defined to have a variable shape, a variable size, and a variable location within the first 

15 set of display data. Consider, for example, that the first set of display data represents 
display data for an entire viewable area of a display component. In one example, the key 
data can be defined to represent a heart shape occupying half of the entire viewable area 
and centered within the entire viewable area. In following, the key data can be defined to 
represent a picture-in-picture window having a variable shape, a variable size, and a 

20 variable location within the viewable area of the display component. As previously 
discussed with respect to one embodiment, the key data can be assigned a data value 
mapped to a color (i.e., RGB value). The data value can be user specified. In this 
embodiment, the key data is referred to as a key color. 

[32] The method also includes an operation 503 for receiving a second set of display 
25 data. The second set of display data is received from a display data source. As previously 
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discussed with respect to various embodiments, the display data source can be a digital 
video camera, a digital camera, an electromagnetic transmission, a digital data storage 
device, or an external MPU host, among others. Therefore, depending on the display data 
source, the second set of display data can represent either a stand-alone single frame of 
5 image data or a frame of image data from a video transmission containing multiple frames 
of sequenced image data. As such, the second set of display data defines an image having 
a shape and a size. 

[33] The method further includes an operation 505 for comparing a portion of the first 
set of display data to the key data value. The portion of the first set of display data used in 

10 the comparison of operation 505 represents an image overlay area contained within the 
viewable area of the display component. The image overlay area is defined to correspond 
to the shape and size of the image represented by the second set of display data. In one 
embodiment, the display data for each pixel within the portion of the first set of display 
data is compared to the key data value. 

15 [34] The method continues with an operation 507 for modifying the key data within the 
portion of the first set of display data using corresponding portions of the second set of 
display data. In one embodiment, modifying the key data is performed by replacing the 
key data with the corresponding portions of the second set of display data. In another 
embodiment, modifying the key data includes performing logical operations using the key 

20 data and the corresponding portions of the second set of display data. Examples of the 
logical operations that can be performed include AND, OR, XOR, A VG, BITSHIFT 
LEFT, BITSHIFT RIGHT, among others. It should be appreciated by those skilled in the 
art that modifying the key data can be performed using other logical operations not 
explicitly exemplified. 
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[35] In one embodiment, the key data is modified using the corresponding portion of 
the second set of display data while the first set of display data is contained within a 
memory. This embodiment corresponds to the snapshot mode of operation as previously 
discussed. In another embodiment, the key data is modified using the corresponding 

5 portion of the second set of display data during a transmission of the first set of display 
data to the display component. In this embodiment, the corresponding portion of the 
second set of display is not written to memory. This embodiment corresponds to the view 
mode of operation as previously discussed. Also in this embodiment, the second set of 
display data includes a synchronization signal. The synchronization signal can be used to 

10 initiate the modification of the key data with the corresponding portion of the second set 
of display data. . 
[36] The method also includes an operation 509 for transmitting the first set of display 
data to a display component. The first set of display data transmitted in the operation 509 
represents the first set of display data existing after the modification of the key data using 

15 the corresponding portion of the second set of display data as performed in the operation 
507. In one embodiment, the display component is a liquid crystal display panel. 
However, the method of Figure 5 can be performed using any suitable type of display 
component. Also, in one embodiment, the first set of display data transmitted in the 
operation 509 can be received and converted to a digital format suitable for storage. In 

20 one example embodiment, the first set of display data can be received by a JPEG CODEC 
component and converted to a set of JPEG data to be stored on a computer readable 
media. 

[37] The display memory of the present invention contains one set of display data for 
the entire viewable area of the display component. The key data is written to the display 
25 memory to define the portion of the viewable area of the display component that will be 
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used for rendering of the incoming display data. In one embodiment, the portion of the 
viewable area of the display component used for rendering the incoming display data is a 
picture-in-picture window. The incoming display data can represent a stand-alone image 
(e.g., picture) or a sequence of images (e.g., video) to be displayed in the portion of the 

5 viewable area of the display component. When operated in snapshot mode, the present 
invention overwrites the key data within the display memory with the incoming stand- 
alone image display data, prior to transmission of the display data to the display 
component. When operated in view mode, the present invention does not require that the 
display data for the incoming sequence of images be written to the display memory. 

10 Rather, in view mode, the present invention uses the display data of the incoming 
sequence of images to modify the key data as the display data is transmitted to the display 
component. Thus, in view mode, the key data remains stored in the display memory for 
use with each incoming frame representing the sequence of images. 
[38] In accordance with the foregoing, the present invention does not require the 

15 storage of additional display data for common pixels. Thus, the present invention reduces 
the amount of required memory. For example, consider a device incorporating a 100x100 
pixel picture-in-picture window displaying an image on a display panel at 16 bits-per- 
pixel. Without the present invention, the memory will need to store display data for the 
entire display panel, including the display area to be overlayed by the picture-in-picture 

20 window. In addition, without the present invention, the memory will need to store display 
data for the picture-in-picture window. The present invention does not require storage of 
additional display data for the pixels defining the display area to be occupied by the 
picture-in-picture window. Therefore, with the present invention, the memory 
requirements are reduced by approximately 19.5 KBytes, which may be significant for a 

25 handheld device having limited computational capabilities. 
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[39] Also, since storage of additional display data is not required for a given pixel, the 
present invention alleviates the need to have separate functionality for determining which 
portion of memory to retrieve data from for the given pixel. Due to the reduced memory 
capacity and access requirements afforded by the present invention, savings can be 
realized in terms of device size, device power consumption, and device cost. Also, by 
eliminating the need to read from display memory more than once for a given pixel, the 
present invention provides improved device performance in terms of operating speed. 
[40] While this invention has been described in terms of several embodiments, it will 
be appreciated that those skilled in the art upon reading the preceding specifications and 
studying the drawings will realize various alterations, additions, permutations and 
equivalents thereof. It is therefore intended that the present invention includes all such 
alterations, additions, permutations, and equivalents as fall within the true spirit and 
scope of the invention. 

What is claimed is: 
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